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(57) Abstract: A method for simulating an appearance of make-up and fashion accessories on an image of a consumer and for 
marketing such products includes compiling a database of a plurality of products having appearance information for each product, 
acquiring a base image of a consumer having a plurality of pixels, identifying a product application area in the base image having 
a blending region, where the product application area and blending region thereof being are by sets of pixels of said base image, 
receiving a product seleaion from a consumer, retrieving appearance information associated with a selected product from the data- 
base, modifying the appearance information of the product application area according to the appearance information of the selected 
product, blending the blending region with the base image by modifying appearance information of pixels of the blending region 
according to appearance information of the selected product and according to appearance information of associated pixels of the base 
image in the blending region, displaying a composite image of the base image as modified and blended in the application area and 
the blending region thereof, and providing means to display an alteniaiive product within the product application area. 
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MAKE-UP AND FASHION ACCESSORY DISPLAY AND MARKETING 
SYSTEM AND METHOD 

Field of the Ihvmtion 

The invention pertains to the field of displ^ systems and methods for simulating the 
5 ^pearance of mske-xip and fiashion accessories, and pertains to a method for marketing make-iQ) 
and &shion accessories. 

Background and Summary of the Invention 

Consumers of make-iq) and fisbion accessoiy products, especial^ liig^-end" make-up 
and fidiion accessoiy products, usually need to see how such products will appear on themsdves 
10 prior to making a purdiase dedsioa Because of this, make-up and fashion accessoiy merchants 
have had a need to rely substantially on physical store locations where consumers can tiy diflferent 
make-up ^plications and accessories. 

Some merdiants have attended to use digital computer imaging technology to provide a 
simulation of make-up products, however, these past systems merdy display various types of 
IS inak&-iq) on models and do not show how such make-up would q)pear on the consumer. 
Moreover, these past systems use fixed photographs and do not provide means to select various 
comUnations of products. Further, the past systems do not provide means to adjust the amount 
of make-up products applied 

Therefore, is desired is a systan and method for life-like simulation of the 
20 appearance of make-up and &shion accessories on an image of a consumer, which allows the 
consumer to simulate various combinations of products and allows the consumer to simulate 
various application amounts of make-up products. Further, what is desired is a mediod of usuig 
an image of a consumer as a vdiicle for marketing make-up products and &shion accessories. 

The present invention provides a system and mefliod in which make-up and accessory 
25 products predsely overlie and smoothfy blend with a digital image of a consumer (e.g., an image 
of the consumer's fece, or head and torso) to create a true-to-life simulation of how such products 
will appear on the consumer. Furth^, the system and method allows the consumer to choose 
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from a large plurality of products, to create a niultq)lici1y of combinations of image simulations, as 
desired by the consumer. Further, the system and method allow the user to modify the image to 
simulate applications of various amounts of make-iq) products, as preferred by the consiuner. In 
addition, the invention provides a method for marketing make-iq) products and &shion accessories 
to a targeted consumer tising a digital image of the consumer, where products precisefy overlie 
and smootfaty blend with the digital im^ to create a conqielling and effective marketiiig vebide. 

Brief Description of the Drawings 

For a con9)lete understanding of the above and other features of the invoition, reference 
shall be made to the following detailed description of the preferred embodiments of the invention 
and to the acconqianying drawings, wherein: 

FIG. 1 is a schematic overview of the conq)onents of a system according to the invention 

FIG. 2 is a screen shot of an initial interfitce of the system 

FIG. 3 is a screen shot of an image simulation interfece 

FIG. 4 is a screen shot of a retrieval intei&ce for loading stored looks 

FIG. S is a process flow diagram of the method of the invention 

FIG. 6 is a color image of a base unage of a consumer 

FIG. 7-11 are color conqposite images showing make-up applied to various make-up 
application areas of the base image 

FIG. 12-18 are gray-scale images representing alpha diannd values of several make-iq) 
application areas of the base image 

FIG. 19 is a graph of the equalization function of the present invention; 

FIG. 20 is a gr^h of the distribution of tfie slope A of the equalization algorithm as a 
function of the intoosity of the product color; and 
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FIG. 21*25 are coiqposite images of various fishion accessories siq^^in^osed over the 
baseimqge 

The file of tbis patent coiitains at least one drawing executed in color. Copies of this 
patent, with color drawings, will be provided the Patent and Trademark Office upon request 
5 and paymoit of tiie necessary fee. 

Detailed Description of tiie Invention 

Referring to FIG. 1 , the method and system of the present invention provides a means for 
consumers to 'liy and buy" make-iq> products and accessories, fi-om virtually any computer in 
virtuaify any locatioa The con5)onents of the system 10 include a host system 1 2 and a plurality 
10 of user systems 14, 16 interconnected by a computer network 4* 19. Preferably, the conq)onents 
of the system 10 are interconnected by the Internet such that the user systems 14, 16 can be 
located anywhere in the world with access to the Internet. 

The host system 12 indudes a host con^uter 18, \diich can conq;)rise one or more 
conq)uters, and a database 20. The user ^ems 14, 16 eadi include a gczpY^c monitor 22 and a 
15 central processing unit 24, which can be of any suitable type. The user systems 14, 16 can be 
'*thin" climts, with nmmnal resources, or can have substantial resources including a data storage 
device, sudi as a hard drive. 

As depicted, the conq)onents of the system 10 can be distributed over a wide geogr^hical 
area. However, it can be appreciated fbst some or all of the con^onents can be included in one 
20 enclosure. For eTcanq^le, it is contenq>lated that all of the conq>onents of the system can be 
enclosed within one ''Idosk", which could be located within a retail store. 

The system uses a digital base image of the head and face of tiie user to dmonstrate how 
make-up and accessory products will appear on the user. This base image can be considered a 
blank canvas of the user and can be acquired using an image capturing device 26 connected to the 
25 user system 14, 16 or can be acquired by digitally scanning a photograph 28 sent to the host 12 fay 
the user. Other methods of acquiring the digital base image are also suitable. 
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Hie database 20 indudes product information for various types of make-up products and 
fisUon accessories, indudii^ appearance information to be used in simulating the appearance of 
tbe products on the base image of the user. Ihemethod requiresonfyaveiy^thin" amount of 
data content to be stored in the database for eadi product - a product's color is represented by a 3 
byte RGB value, vMdIi is oiough for blending engine to produce the photo*realistic look. Two 
msgor advantages ofthis method include the ability to transfer product information quicldy over a 
veiy narrow-bandwidth communication line (Le., low transmission overhead) and the 
conq)atibi]ityof the product information with many types of user systems 

The dient^pUcarion is buik around the color blending and display software e^ The 
dient iq)plication has a protocol for querying the database and getting products d^ails, color, and 
accessories inuiges. It also has a user inter&ce through whidi the user controls fte application of 
colors and accessories to the user's image. These functional controls can be hooked to any menu 
system, k^board, remote control or graphic user interfoce. The descrq^tion below describes the 
system as unplemented via ibe Internet grq)hic global conqsuter network. However, it can be 
appreciated that other in^lemoitations are vnAm the scope of the inventioa 

The gystem User Interface^ 

FIG. 2 displays an initial grq)hic user inter&ce 30 of the system, suitable for access over 
the Internet ttroi^ a standard browser. The initial interfiice 30 indudes means for new users to 
register with Ae host system 12 and means for registered users to login (using aunique user-name 
and password combination). 

Referring to FIG. 3, an image simulation graphic interfiice (ISI) 33, for the iat&ns^ 
accessible fiirougji a standard Intraiet browser, provides a smgle interfece through whidi users 
can "tiy and buy" cosmetic make-q> products and fiishion accessories, and other rdated products. 
Tbe ISI 33 includes the user's base image 02, a category list 32, and a subcategory list 34. 

Hie categories in the category list 32 can indude eyes, lips & face, accessories, nails, hair, 
and other categories of related iteuB. Hie subcategoiy list 34 is dependent upon the categoiy 
chosen (Le., hig^gjited or clicked upon). As shown, if the lips & fece categoiy is chosen, the 
subcategory list 34 can include: lipstick, lip-gloss, lip p^cil, blush, foundation, power, and others. 
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Subcategories for the Hps categoiy can include: eye shadow, eyeliner, mascara, eye pencil, etc. 
Subcategories for accessories can include: qre wear, eairii^, necklaces, pendant, and die like. 
Hie subcategories for nails can include various types of nail poHsh. Simila^, the subcategories 
for hair care can inchide various hair dies and Ughfigfats, and llie like. 

S The ISI 33 also inchides a brand name list 38, whidi is retrieved from the database 20 and 

^ch is preferabfy dependent upon tiie cat^oiy and subcategory chosen by the user. Hie ISI 33 
also includes a products list 36, which is preferably depsident upon tiie category, subcategory and 
brand name diosen by the user. 

Hie ISI 33 also indudes a color selection interfoce (CSI) 44, whidi displays color options 
10 available for the chosen product Preferab^ the CSI 44 displ^s relatively enlarged graphic 
images of the products to dearly indicate the various color options. The user can dbose a color by 
highligfatii^ or clicking upon one of the colors displayed in fte CIS 44. Upon such a selection, 
the system 10 displ^^s the chosen product on foe base image 02 of foe user in foe ISI 33 in a 
mefood describe in detail below. When a color is diosen from foe CSI 44, foe systmi 10 also 
15 preferably displays a fiiD im^e of foe product and its padcaging in a product details section 40 of 
the ISI 33, aloQg wifo descriptive and price informatioa 

Referring to FIGs. 6, foe base unage 02 of foe consumer is preferably an image of the 
consumer wifoout any make-up (or wifo only base make-up); foereby forming foe 'T)lank canvas'* 
upon which make-up products will be s^plied, wifo foe digital blending technologies of the 
20 invention. 

FIGs. 7-10 display how foe base image is altered by the system when make-up products 
are ^plied to various portions of a base image. Specifically, HG. 7 shows red blush ^plied to 
the cheeks on foe base image; FIG. 8 shows blue eye liner applied to foe upper eye lid on foe base 
image; FIG. 9 shows red lipstick applied to foe lips on the base image; and FIG. 10 shows purple 
25 eye shadow applied to foe iq>per eye lid on foe base image. 

The ISI 33 also indudes application controls 45 to adjust foe "amount" of foe make-up 
product ^plied to foe base image 02. Specifically, foe q)pIication controls 45 include means to 
increase foe amount of make-up (Le., "heavier"), to decrease foe amount of make-up ("lighter") 
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and to reset the application amount to an initial, or de&ult amount C'leset''). 

FIG. 1 1 is image of a significantly reduced amount of eye shadow applied to the base 
image as conq)ared to tbat of FIG. 10. 

The ISI 33 also includes a save function 54 vMA directs the system 10 to save 
5 information regarding the cuirent state of Ihe image in the ISI 3 3, inchiding the products currently 
applied to the image and any variations in the application of the products directed by the user 
dirougli the supplication controls 44. For purposes herein, such information will be collectively 
caUeda^Iook." 

The look information is preferabty recorded in a specified format, either on the user's 
10 system 14,16 or on the host 12, or both. Preferably, the look file also contains a look image file 
representing the base image with the products identified in the look file applied thereto. The look 
image can be of a reduce size and/or resolution. The system 10 is able to use the product 
information contained in a look file with any base image of any user. 

Referring to FIG. 4, the system 10 includes a retrieval inter&ce 72 for retrieving saved 
15 "looks. Preferabty, the retrieval interface 72 inchides arelatively small (e.g., thumbnail) image of 
one or more saved looks such that the user can conveniently and efficiently identify a desired bok 
to load Also, upon initial selection or highlighting of a saved look (eg., by clicking once upon 
the associated thumbnail image), the retrieval inter&ce 72 preferabfy displays written details 
r^arding the products included in flie look in a product detail portion 70. When a look is chosen 
20 from the retrieval inter&ce 7?, the system diaiiges to the image simulation inter£Eu:e 33 and 
diq^lag^ the chosen look, whneby the user can manipulate the look as previously desaibed. 

The ISI 33 also includes an email control 58 to sea^ the current look information and/or 
current image to another as an attachn^t to an electronic mail mess^e. The system 10 provides 
means to allow a recipient of such a message to load the image created by the sender (if siq>plied) 
25 or to apply the look to their base image 02. 

^Vhen appropriate^, the ISI 33 also includes controls to adjust the appearance of 
accessories displ^ed with the base image (not shown). For exan^le, the ISI 33 preferably 
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includes controls to adjust Ifae scale and oriraitation of tiie image of the accessoiy. Furdier, the 
ISI 33 includes controls to dear 60 all product from the base image 02, and to print 56 Ibe current 
image on a printer. 

Further, the ISI 33 preferably includes an electronic ''shopping cart" section including 
5 controls to add 46 and clear 48 products to and from the shopping cart, and a control to buy 50 
products currraitly in the shopping cart. Thus, the image simulation inter&ce 33 provides a 
means for consumers to select various make-up and accessoiy products, visualize how those 
products win appear on themselves, and then purchase ftose products, all from one interface. 

The Ttnftge Sitn ulation Process 

10 Referring to FIG. 5, an initial step 1000 of the method of the invention is compiling a 

database of information regarding a plurality of make-up and fashion accessoiy products. For 
make-up products, the database includes the product name, brand, category, subcategoiy cost, 
and a brief description of the product, . The database also includes q)pearance information for a 
make-up products includes a three-bit RGB color representation and two 1 byte parameters for 

15 l^er texture and light reflectivity (i.e., "glossiness'O. For accessoiy products, the database 
includes the product name, categoiy and cost, one or more digital images of each product, and an 
anchor point for eadi digital image. 

The method also includes a step 2000 of acquiring a digital base image of a user. As 
stated above, this can be acoon^Iished througb any suitable digital image-capturing device or 
20 systeni, and can be made by imaging the user, or by digitally scanning a photogre^h of tiie user. 

The base image is thai processed 3000 to identify areas in which make-up and accessoiy 
products are to be applied. This processing is preferably performed at the location of the host 
system 12 and can be done by any suitable combination of manual and automated processing. 
Pkel infiDimation of the base image is preferably stored in a base image file, in a bitmap RGB 
25 bands in, for exanq)le, a ' W format. The information regarding placement of make-up products 
on the base image, is also stored in the base image file along with the base image information, in 
sq)arate ''alpha channels", in the tiff file. 
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Tlie first process in step 3000 is detenmniag the base image size fitcto r and rotation fictor 
according to die size and orientation of the head/&ce of the user within the base image. 
Specifically, a pixel dimoisicn of the head/fiu» in the base image is conq)aied to (i e. , divided by) 
a predefined standard dimension to calculate die size fictor. A primaiy rotation fictor (Le. a z- 
5 axis rotation fictor) is calculated by con^aring an axis of the base image (e.g., the longitudinal 
axis of the fiu:e) with the vertical axis of die base image. Secondary rotation &ctors (i.e., y-axis 
rotation &ctors) can also be conq>uted for other features of the base image, sudi as the orioitation 
of die ear lobes m the base image fi>r propeitjr orienting drop earrings. The image can then be 
aopped to die confuted size and rotatioa 

10 

Furdier, andior points fi>r locating accessory product imag^ are defined by idoitifying 
(x,y) coordinates of associated pbcels widiin the base image. For exaniple: a point midway 
betwem die pupils can be identified as an anchor point for ^e wear; points adjacent each ear lobe 
can be identified as an andior points for earrings; and the two points v^ere a necklace would 
is disappear (as it passes around the neck) can be identified as a anchor points for necklace. 
Further, fi>r eyewear, the system calculates a rotation angle between a line connecting the pupils 
and the axis of the base image. The andior points, along widi the size and rotation fectors for 
qrewear are recorded widiin the base image file, preferably in a header portion thereof 

For each base image , one or more make-up application areas are defined for eadi make- 
20 up product type and are assigned a separate alpha diannel within the base image file. Each alpha 
channel is a pixel-by-pixel map representing where and how much of an associated make-up 
product should be placed widun die base image. Preferabty, the alpha values in the alpha channels 
range in scale from an upper limit (e.g., 255) to a lower limit (e.g , 0). An alpha value equal to die 
lower limit (0) indicates that the color of the associated make-up product should be applied to the 
25 associated pixel in the base image, without modification (Le., without blending). An alpha value 
equal to the upper limit (2S5) indicates that the color of the make-up assodated make-up product 
should not be applied to the associated pixel in the base image. 



The make-up application areas have blending regions wherein the alpha values range 
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between flie tqyper and low^ limits (0<Mphst<2SS) indicating that the color of tiie associated 
make-up product should be blended, according to the alpha value, with the color of the associated 
pixel of tfie base image. 

Referring to FIGs. 12-18, for explanatory purposes, the alpha values for various make-q) 
^plication areas are depicted in gray-scale images reflecting the alpha values for associated pixels 
in the base image. In the representation en^loyed in FIGs. 12-1 8, a darker shade of gr^ indicates 
a low alpha value, which results in a greater weighting given to the color of the make-up product 
during the blending process. Conversely, a lifter shade of gray indicates a hig^ alpha value, 
vMdoi results in a lesser weighting giv^ to the color of the make-up product. 

FIG. 12 displays alpha values suitable for blending lip liner products, on the periphery of 
thelips. FIG. 13 displays alpha values smtable for blsiding lipstick products on the lips. FIG. 14, 
displays a^ha values suitable for blending blush products on the cheeks. FIG. IS displays alpha 
vahies suitable for blendiQg eyeliner products on1hetqn>er q^elid. FIG. 16 displ^s alpha values 
suitable for tdendingeydiner products on the lower eyelid. FIG. 17 displays alpha values suitable 
for blending eye shadow on a lower portion of the vppet eyelid. And, FIG. 18 dispkr^s alpha 
values suitable for blending eye shadow on an upper portion of the upper eyelid. 

At the end of the processing line, the data size of the base image file is preferably reduced 
Specifically, the three bands of the image are compressed and the alpha diannels are encoded in a 
unique format with vAdch the color-^plyii^ engine works. 

Hie base image file, containing the information obtained during processing, can be stored 
on the host system 12 and transmitted to the dient system 14, 16 as needed (at session startiq) for 
instance). Altemativefy, if the dieht system 14, 16 includes a storage device, the base image file 
canbetransferredtotiie client system 14, 16 in any suitable nmnner- for exainple fay transrnitting 
tfaejbase image file over the network 19, or by recording the base image file on a portable storage 
medium and sending ^e medium to the user through the mail- and Htm recorded on the user 
system. For Internet based inq>lementations, tiie user can download fte processed base image 
firom the host 12 over the network 19, or can receive Ae base image via electronic mail 

Referring ^ain to FIG. 5, in stq> 4000A, the user selects a product fi-om the database 20 
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using the image siniulation inteifice QSl) 33, as described above. In response to the user's 
selection, die host system 1 2 sends the product information stored in the database 20 to the client 
system 14, 16. To simulate the appearance of the selected product on the base image of die user, 
the color infonnation of the selected product is modified and blended according to the color 
5 information of the base image; in steps 5000 and 6000, to create a conq>osite imaga 

In the modification step 5000, the ^pearance information of the base image (or at least 
^ appearance mformadon of the associated make-up plication area) is modified, simulating the 
physical process of color ^plication, to create the ^pearance that die make up r^on has been 
foOy covered with the color of die product, and was photographed at the same iUumination and 
10 shading as the base image. This is achieved by using the intensities of the make-up area of base 
nnage(as ablackand\vbiteimage)to whidi the product color is qjplied. 

First, the image is converted firom the Red-Green-Blue (RGB) fi)rmat to a Hue-Saturation- 
Intensity (HSI) fi^rmat. llien, the intensity image undergoes a contrast stretdiing (or 
^'equalization'^ procedure m which the intensity values (0 of the pbcels in the make-up plication 

15 area are adjusted according to a predetermined equalization algorithm. Hie arguments of the 
equalization algorithm are: (1) the difference in intensity between the q)plied color and mean 
intensity of the pixels of the make-up area, and (2) the variance of the intensities of the pixels of 
the make-iq> area. The hue and saturation vahies (liS) of the pixels in the make-up application 
area are set equal to the hue and saturation values of the selected make-up product Hiis process 

20 preserves details, higjdights and shadows present in the original base imaga 

Referring to FIGs. 19 and 20, the algorithmfor equalizing the intensity values of make-iq) 
appUcation area is a linear function whose parameters are conq)uted firom the statistics of die base 
image make-up application area and the intensity of the product color, as follows: 

Ioat = A*Iin+B 

25 Where; 

lout is the value of the intensity of apixel of the equalized area , 

lout can range between Upper and I^wer Limits of 255 and 
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0, respective^, 

lb is &e value of the intensity of an associated pixel of the make- 
up plication area of flie base im^ge (before equalization), 

liQ can range between the Upper and Lower Limits, 

A is the slope of the function and is coni^uted according to a 
gaussian distribution function, as follows: 

A = exp(-0.5 ♦ (WW^/W^ 

Where, 

Icoiar is tiie vahie of the intensity of the applied 
product color, 

Imean is mean value of the intensities of the pixels in 
the make-up application area, and 

l«tdevis the variance of the intensities of the pixels in 
the make-up application area, 

B is a constant con:9)uted by equating the lia and lout values in the 
equalization ftmction to In»an and Icoiar » respective^ 

According the above formula, pixels in the make-up application area of the base image 
having the mean intoisity value of the make-up application area will be assigned an intensity value 
exactly equal to the intensity value ofthe product color. Pbcdsofthe make-up application area of 
the base image having intensity values other than the mean intensity value will be assigned 
intensity vahies spread around intensity value of the product color according to the variance in 
intensity of tiie make-up ^plication area of the base image. 



For extreme differences in intensity value between the applied product color and the pixds 
of fte make-up application area of the base image, the slope A of the equalization fimction is 
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nx}dified according to the following: 

For Icolor - Irnean > 2* W, 

Inean IS replaced by lacm*OA + leolcr* 06 
For Icokir Imean ^ "'2*Istdevj 

5 Lnott is replaced by 1.2* Imen 

The equalization function can be repr^ented in one or more look-up tables stored on the 
cHeat system and/or the host system, as appropriate. 

After applying the intensity equalization fimction and changing the hue and saturation to 
tixe assodated values of the applied color in the make-iq) application area, ne^ct, the H,SJ values 
10 of the pixds in the make-up application area are re-converted back into l!ti& RGB format, by a re- 
conversion procedure, using an inverse of the transformation described above. 

In a blendii^ step 6000, the pixels of the blending region of the make-up application area, 
\)vhicfa by definition have alpha valu^ between the upper (255) and lower (0) limits, are blended 
with the assodated pixels in the original base image to form the fully colored base image. An 
15 ofi&et value (constant to all pbwls in the make-up application area) is also introduced vAidt 
governs the '^amoimt'' of applied color relative to the amount of original color in final imaga lUs 
of&et value is controlled firom the 'Heavier'TLig^ter" color ^plication controls on the image 
simulation mt&Sace (ISI). 

Spedficalty, &e red, green and blue color values (Rc, Gc, Be) of the pixels of the blending 
20 region of the make-up application area are determined by the following formulae: 

K0» [Rb * Alpha + * (Alpba - UpperIiimt)]AJpperIi2xiit 

GcF= [Gb ♦ Alpha + Gp * (Alpha - UpperLimit)]/UpperLimit 

Bo= [Bb * Alpha + Bp ♦ (Alpha - UpperLimit)]/UpperLimh 



Where: 
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Rb, Gb, Bb are respective tiie red, greea and blue color values of the associated 
pixdis in the ortginal base image; 

Rp, Gp, Bp are respective^ the red, green and blue color values of the associated 
pkels in the blending region of the modified make-up application area; 

5 A^dia is the Alpha value of &e assodated pixel in die Uending region of the 

make-up applicaticm area minus tiie alpha ofi&et value obtained from the 
*1ieavier^/*1ighter" controls; and 

UpperLimit is the predefined upper limit of the Alpha values. 

Upon completion of the modification and Uending steps 5000, 6000, the conposite im^e 
10 is disp]ayed 7000A in the image simulation inter&ce (ISI) 33. It should be noted that the 
calculations of the above modification and blading steps could be made by the user system 14, 
16, by the host system 12, or by any condrination thereof 

Hie combination of defining accurate make-iq) application areas and blending regions (in 
15 the processing step), preserving details, hig^g^ts and shadows (in the modification step), and 
blending colors fix>nithe base imoge in the blending region of fiie make-up appUcation area On the 
blending step) adiieves a veiy Ugh, and heretofore unavailable level of realism for simulating 
make-up applicatioa 

In a fiirther a^usting step 8000, the user can adjust the Aamount@ of make-q} applied by 
20 the system to the base image. As set forth above, the ISI 33 includes application controls 45 to 
increase or decrease the amount of make-up applied to the base image. These controls eflfectivety 
adjust the ofi^ to the alpha vahies of the pixels of the blending region to affect the respective 
weights given to tiie colors of tiie pixels of the original base image and of the pbcels of the 
blendiog region of the modified make-up application area 

25 Referring to, ^en the user directs the system to lighten the application of make-up 

(compare FIGs. 10 and 1 1), the alpha values fi3r fte blending region of the make-up application 
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area are increased by a predetermined amount to increase &e weight given to the colors of the 
pixels of the original base image. Tbm, the blending step 60(K) is repeated to recalculate the 
blraded colors to create an adjusted composite image, and the adjisted composite image is re- 
displayed in the ISI 33. 

Conversely, when the user directs fte ^em to increase tiie application of make-iq), the 
alpha vahies for flie blending region of the make-up application area are decreased by a 
predetermined amount to decrease the weight given to fte colors of the pixels of the original base 
image. FIG. 10 shows a make-iq} product applied in a standard or de&ult amoimt FIG. 1 1 
shows the same make-up product applied in a lighter amount. Preferably, the system inq)oses a 
limit upon how mudi the user can increase the ^plication of a given make-iq> product so as to 
avoid undesirable results. For example, the system can limit the increase in application by 
between about 40% and 100% of the standard or de&ult amount 

Make-up products are often applied in completely or partially overlapping layers. For 
example, blush is often applied over a foundation, and different shades of eye shadow make-i^ are 
commonly applied in overl^piiig l^ers. Depending on the amount of application and color of the 
ova'lying product, the underlying product will often affect the appearance of the overling 
product. Therefore, in rendering images, ^ch include sudi overl^pmg make-up products, the 
system blends the colors of the products together in the region in which th^ overly. 

To render the image of overlapping make-up products, the system confutes the 
conq)osite image in iterative, sequential steps. First, the system conq}utes the composite image 
with ftie imderfying make-up product, in the manner set fordi above (i.e. , modifying and blending 
with the original base image). Then, the system ^plies the overlying product in the same manner 
using the first conqiosite image as the '^ase" image. The system applies overlapping make-up 
products in a predetermined order, generally recognized as the proper order of applicatioa 

Referring to FIG. 3, the ISI 33 includes controls 47, 48 to apply eye shadow to dther a 
primary area or a secondary area, ^cfa overlap, as can be seen from the graphic representations 
of the areas adjacent the controls. Preferably the controls 47, 48 function similarly to so-called 
"radio buttons", and are mutually exclusive, whereby turning one "on" turns the other "off.** 
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To render con^osite images of accessoiy products with the base image, the system aligns 
die anchor point of the image of the acc^soiy product (which can be the first pixel in the image 
or any other predefined pixel) with the assodated anchor point coordinate contained in the base 
5 image file (described above). The system adjusts die size of the image of the accessoiy product 
according to the size &ctor contained in the base image file. Further, the system adjusts the 
orientation (angle) of the accessoiy image according to the rotation factor(s) contained in the base 
image file. 

FIGs. 21 and 22 displ^ accessoiy products raidered with the base image. 
10 Specifical^, FIG. 21 shows drop earriiig accessoiy products correctly aligned so as to appear to 
be hangii^ fiomtfae ear lobes of tiie consumer's image. As can be appreciated, the orientation of 
each earring is adjusted to appear realistic. Specificalty, eadi earring accessoiy products have 
been separately rotated around ay-axis so as to appear to hang naturally. FIG. 22showsahat 
siqioimposed over the base image. 

15 Referring to FIG 23, the product image may include transparent areas (e.g., the center 

area of an image of a loop earring, or the area surrounding the product in the image) in whidi the 
base image will appear unmodified. The product image may also include semi-transparent areas 
(e.g. tinted l^es of eye wear as shown in FIG. 23) in which the product image is blended with 
the base image. Thus, after alignment, size adjustment and orientation of the accessory product 

20 image, the system blends the product image with the base image using die alpha values of the 
pixels of the product image. 

In a processing step similar to diat described above for make-up application, the semi- 
transparent areas of die product image are assigned alpha values between the upper and lower 
limits (255,0), thus creatiiig blending regions in the product image. As stated above, the alpha 
25 values are preferabty contained in alpha channels in the product imoge file. 

In a blending step similar to that described above, the color information of the pixels in die 
blending regions is blended widi die color information of the pixels of the base image, using the 
blending algorithms set fordi above. Upon completion of the blending step, the composite image 
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including the tdended product image is displayed in Ifae ISI 3 3. 

To render images of hair products, the system enq)loys image processing, modification and 
rmdering steps similar to those described abova Spedfically a hair product application area is 
defined, with associated alpha values and the color of tiie hair in the base image is changed using 
the modification and bloiding steps as above. As above, the system preferably allows the user to 
adjust the color effect of the hair product. Tlie infomiation regarding ^plied hair products can be 
saved in (and loaded from) the product information "look" file, as described above. 

Referring to FIGs. 24 and 25, to render images of nail products, tiies;ystempre&rably uses 
a "stock" im^e of ahand (FIG. 24), firomfor example ahand model, and similar steps are used to 
simulate nail products (e.g., nail polish) applied to the nails of the image. Thus, nail product 
application areas are defined 0. e., the nail areas), wifii associated alpha values (if necessary), and 
the color of die nails in the image is dianged using the modification and blending steps as above 
(no. 25). As above, the nail product information can be saved in a product information file. 

The Marketing Methods of the Invention 

The marketing method of flie invention provides new and powerful tools for promoting 
cosmetic and &shion products, most suitably via the Intemet. Retailers can use the technology of 
the invention to promote various products and introduce to tiieir potential dients a dependable 
simulation 

of how they will look wearing their products. Using customer's own photos, and based on 
shopping behavior, retailers and manu&cturers can direct their marketing efforts to a focused 
audience and feature a new and vivid experience. 

In one marketing metiiod of the invention, the system 10, selects one or (preferably) more 
make-up, hair, nail and/or accessory products, or other products firom the database 20. Hiis 
selection can be made at fhe request of a third party (e.g., a manufecturer of tiie products) without 
direct input firom the consumer. The systemthen creates eidier a fidly rendered composite image 
of the consumer with the selected products, using the consumer's own image as die base image, or 
noerely creates a "look" information file containing the selected product informatioa Next, the 
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system soids the fidly rendered composite image, or ttie look information file to tiie consmner. 

The Mfy raidered conq>osite image or the look information file can be delivered to the 
consumer in any suitable manner induding electronically (e.g., via electronic mail), in a 
photograph, or on a conq)uter-readable mediimi (e.g., on a CD). In addition, san5)les of the 
5 products shown in the composite image or file can be ddivered to the consumer simultaneous^. 

If the con^osite image or look information file is ddivered to tfie consumer electronicaDy, 
or in a conq)uter*readafale foimat, fbe consumer can use the client system 1 4, 1 6 to bad the in^ge 
or file through the retrieval inter&ce, and can view die resulting image through the I SI 3 3 . 

In another marketing method of the invention, ^look codes" are posted or published, for 
10 exanple in traditional advertisem^its (e.g. print, television or radio ads) or electronic 
advertisements (e.g, banner ads in web pages), which codes are associated in the system with 
predetermined make-up and/or accessory products, and particular applications of sudi products 
(i.e., various make-up 'looks'*). Preferably such codes appear in advertisements of manufectuiers, 
\^*ich advQtisements depict or describe make-up products applied to models, and the codes are 
15 aligned near (or otherwise associated with) a brand name of the system (e.g., EZFace). Upon 
access to the system, the consumer enters the "look code", whidi directs the client and/or host 
system to displ^ the products ovct the (previously c^tured and processed) base image of the 
consumer, as described above, so that the customers can see for themselves how the products 
will look on themsdves. This method enables manufacturers to efficiently demonstrate their 
20 products to customers in a discrete and personalized manner. 

In another mariceting method of the invention, Internet web pages are provided with 
electronic links (I e. hypertext links), whidi when dicked upon, cause the client system to display 
the consumer's image with a predetermined application of make-up products and/or accessories. 
The links can take say suitable form (Le., text links or image links). Preferably, the links are 
25 aligned adjacent to or otherwise associated with images of models wearing the make-up 
Implications, or associated with make-up or accessoiy products. 

If the user inter&ces of tiie system are inq)lemented through a standard browser, such as 
with a "^lug-in"' or script, then the link can include anetwork address of the host system 12 (i.e.. 
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the mi) and an embedded look code vMcli is received hy the host system 1 2 upon dicldng upon 
the linL Upon login to the system, the system tiim uses the embedded look code to retrieve the 
look infonnation from the product database, and then displ^ the products on the image of the 
consumer, as described above. 

5 If the \3S&r inter&ces are m^Iemented through a separate cU^t £q>plication, the client 

system can include a listening program running in the background which monitors when a 
l^ertext link is clidced upoa The listening program retrieves the embedded look code, launches 
the chssat application (if required), and passes die look code to the dient application, when then 
contacts the product database (tfarougji the network and host) to retrieve the product information, 

10 and to displ^ the composite image. 

Further, the system can record a consumer's buying and "trying" habits in a consumer 
history database located on ihe host system 12, wfaidi can then be used to target personaUzed 
product maiketii^ to the consumer, or to conduct higUy accurate market studies about consumer 
preferences. 

15 It can be appreciated that the marketing method of the invention provides a powerful and 

persuasive marketing tool because the us^ can see the products as applied to their own image, 
and, through the system can easily and convenienth^ purchase the products. 

Multi-UsCT Sessions 

In addition, the system 10 provides means whereby two or more users can manipulate a 
20 single base image simultaneously. This provides a powerful tool whereby friends or students can 
try different make-up applications together, in an effective and entertaining manner. 

In this method, a first client system 14 and a second client system 16 are interconnected 
via the host system 12, through die network 19. Ihe initial inter&ce 30 of the system 10 
preferably inchides a link, labded for example "Shop widi a Friend", which when selected 
25 preferably provides means for each user to select another user or groiq). Whoi this feature is 
enabled, the ISI 33 of each user displays an identical base image, which can be the base image for 
(me of Ifae users. Modifications made at one client system 14 are monitored by (transmitted to) 



wo 02/05249 



19 



PCT/IBOl/01495 



llie host system 12, and tlieii traiisinitted to the oflier client sj^stem 16, ^^lere the modifications are 
made or displayed on the ISI 33 of the recehdng client system, in accordance with the methods 
described above. 

Optionally, the system 1 0 prohibits one of the users from making modifications to tiie base 
image. Similarly, if a multiplicity of users are similar^ interconnected through the system(e.g., in 
a group or class), the system prohibits all but one of the users (e.g., die instructor) from making 
modifications. The information flow and routing of information over the network 19 during 
multiple-user sessions can be managed by the host system 12 or a dedicated system for such 
fimction, which can monitor user requests and can log pre-scheduled dates for ""net meetings." 

It should be understood, of course, that the spedfic form of the invention herein iOustrated 
and described is intended to be representative only, as certain changes may be made therein witti- 
out departii^ from the dear teadiings of the disclosure. 
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What is daime± 

l.A method for sunulating an appearance of products on an image of a consumer, compiising 

- conq)i]ing a database of a plurality of prodiicts, said database including appearance information 
5 for eadi said product 

. acquiring a base image of a consumer, said base image inchiding a plurality of pixels 

- identifying a product application area in said base image, said product application area indudipg 
10 abloiding region, said product ^plication area and said Uraiding region tfiereof being defined by 

sets of pixels of said base image 

- receiving a product selection from said consumer 

15 • retrieving ^pearance information associated with said selected product firom said database 

- modifying appearance information of said pixels of said product application area according to 
said ^pearance information of said sdected product 

20 - blending said blending region with said base image by modifying q)pearance infonnation of said 
pixels of said blending region according to appearance infonnation of said selected product and 
according to £q)pearanoe information of associated pkels of said base image in said blending 
region 

25 - displaying a composite image of sdd base image as modified and blended in said appfication area 
and said blending region tfaoreof 

- providing means to display an altCTative product ynAm said product s^plication area 



30 



wo 02/05249 



21 



PCT/rBOl/01495 



2. A metho d for simulating an appearance of pro ducts on an image of a consumer, as in claim 1 , 
fiirtfaer conq}risix^^ 

S - assigning alpha channd values to each pixel of said set of pixels of said product application area, 

- blending said product application area with said base image by modi^ii^ appearance 
characteristics of pixels of said product application area according to appearance information of 
said selected product and according to appearance information of associated pixels of said base 
10 image 

in said blending step, weighing said ^pearance information of said associated 
pixels of said base image and ^pearance information of said selected product according 
to alpha vahieso&ssociatei^ixelso&aidmake-upqjplicationarea 

IS - 3. A n^od for simulating an appearance of products on an image of a consumer, as in 
daim 2, further comprising: 

-in said blending step, weighing said appearance information of said associated pixels of said base 
image in reverse proportion to appearance information of said selected product. 

20 

4. A method for simulating an appearance of products on an image of a consumer, as in claim 3, 
fiir&er comprismg: 

a red color value (Rc) of said pbcels of said product application area in said composite 
25 image being determined by the following fonnula* 

Rc= [Rb * Alpha + Rp * (Alpha - UpperLimit)]AJpperLimit, vs^iere 
Rb is a red color value of an associated pixel in said base image 
Rp is a red color value of said selected product; 
30 Alpha is an Alpha value of an associated pixel in said product application area; 

and 
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UppedJmit is a inedefined uppet fimit of said Alpha values 

a greea color value (Gc) of said pixels of said product ^plication area in said conq)osite 
image being detennined by ^ fottowing fonnula: 

5 

Gcr= [Gb ♦ Alpha + Gp * (A^ha - UppeiLimit)] AJpperLinrit, where 
Gb is a green color value of an associated pixd in said base image 
Gp is a green color value of said selected product; 

Alpha is an Alpha value of an associated pixel in said product application area; 

10 and 

UpperLimit is a predefined upper limit of said Alpha values; 

and 

a blue color value (Be) of said pixels of said product q>plication area in said conq>osite 
15 image being detennined fay fhe following fonnula: 

Bcr= [Bb ♦ Alpha + Bp ♦ (Alpha - UpperLimit)] AJpperLimit, \viiere 
Bb is a blue color value of an associated pixel in said base image 
Bp is a blue color value of said selected product; 
20 Alpha is an Alpha value of an associated pbcel in said product application area; 



and 



UpperLinnt is a predefined upper limit of said Alpha values 



5. A method for simulating an appearance of products on an image of a consumer, as in claim 1, 
25 herein: 

said step of xjoodifymg appearance diaracteristics of said pixels of said product 
application area fiirdier comprises 



30 



- assigning hue and saturation appearance values of said pixels of said product 
sq)plication area equal to hue and saturation appearance values of said selected product 
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assigmng int&isity appearance values of said pixels of said product ^plication 
area according to intensity appearance values of a plurality of pixels within said product 
tq)plication area in said base image and according to intensity ^pearance values of a 
plurality of pixels outside said product application area 

5 

6. A metbod for simulating an ^pearance of products on an image of a consumer, as in claim 5, 



- said step of assigning intensity appearance values of said pixels of said product 
10 application area further coirprises en^loying &e following formula: 



Io„i = A*Ii„+B 



Where; 

15 loot is the value of the intensity of a pixel of the equalized area , 

loot can range between Upper and Lower Limits of 2SS and 
0, respective^, 



Ii„ is the value of the intensity of an associated pixel of the product 
20 application area of the base image (before equalization), 

litt can range between the Upper and Lower Limits, 



A is the slope of the fimction and is computed according to a gaussian 
distribution function, as follows: 

25 

A = exp(-0.5 * OcoiorW^/W^) 



Where, 

Icoior is the value of the intensity of the applied 
30 product color, 

Inean IS mean value of the intensities of the pixels in 
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the product q}plication area, and 

Istdev is the variance of tbe intoisities of the pixels in 

the product appfication area. 



5 



B is a constant computed by equatiiig tfie Ih and lom values in the 



equalization function to Imn and ledioi, respectively. 

7. A method for simulatii^ an appearance of products on an image of a consumer, as in claim 5, 
herein: 



area fiuther conq}rises assigning intensity appearance values of said pixels of said product 
q)plication area according to intensity ^pearance values of substantially all of said pixels in said 
base image. 

15 8. A niedK>d for sixnulating an appearance ofproducts on an image ofaconsuiner, as in cl^^ 

- said stq> of assigning intensity appearance values of said pixels of said product 
application area further comprises enq)loying the following formula: 



10 



said step of assigning intensity appearance vahies of said pixels of said product application 



20 



U = A*Iia+B 



Where; 

lout is the value of the intsisity of a pixel of the equalized area , 



25 



lout can range between Upper and Lower Limits of 255 and 0, 
respectively. 



lin is the value of the intensity of an associated pixel of the product 
spplication area of the base image (before equalization), 
lin can range between the Upper and Lower Limits, 



30 



A is the slope of the function and is coiiq)uted according to a gaussian 
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distribution functioii, as follows: 

A = exp(-0.5 ♦ (leoicrlocJ^/Wv^ 
Where, 

5 Icdor is the value of flie intensity of the applied 

product 



10 



color, 

lonn is mean vahie of the intensities of the pkels in 
die product qiplication area, and 
I«d6v is the variance of the intensities of ttie pixds in 
the product application area. 



B is a constant computed by equating the lis and lout values in the 
15 equalization function to Ioku and looior > respectively. 

9. A method for simulatii^ an q}pearanceofproducts on an image of a consumer, conq)risi^ 

- compiling a database of a plurality of products, said database including appearance 
20 information for each said product 

- acquiring a base image of a consume-, said base image including a plurality of pixels 

- idratifying a product application area in said base image, said product application area 
25 including a blending region, said product application area and said blending region thereof being 

defined by sets of pixels of said bas e image 

- assigning alpha channel values to each pixel of said set of pbcels of said product 
application area, 

30 

- receiving a product selection from said consumer 
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- letiievii^ ^pearance infonnatioxi associated with said sdected product 6ota said 
database 

5 

. assigning hue and saturation q)pearaace vahies of said pixels of said product cqiplication 
area suhstantialty equal to hue and saturation appearance values of said selected product 

- assigning intensity appearance values of said pixels of said product q[)plication area 
10 according to intensity appearance values of a phirality of pixels within said product ^plication 

area in said base image and according to intensity ^pearance values of substantially all of said 
pixels of said base image 

- said intensity are assigned according to a predetermined algorithm, comprising en^loyipg 
15 the following formula: 

Io«t = A*Iin+B 

Where; 

20 loot is the value of the intensity ofa pixel of the equalized area, 

lout can range between Upper and Lower Limits of 2SS and 
0, respective^, 

lin is the value of the intensity of an associated pixel of the product 
25 application area of the base image (before equalization), 

lin can range between the Upper and Lower Limits, 



30 



A is the slope of the function and is computed accordirig to a 
gaussian distribution function, as follows: 
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Where, 



Icote is tiie value of the intensity of the applied 
product color, 

is mean value of the intensities of the pixels in 
tfaeproductapplicationarea,and 
Istdev is the variance of the intensities of the pixels in 
the product application area. 



10 

B is a constant conq)uted by equating the Im and lout values in the 
equalization function to Innn and Icoior, respectively. 



- blending pixels in said product application area of said product application area with said base 
15 image by modifying appearance information of said pixels of said blending region according to 

said alpha values 

- a red color value (Rc) of said pixels of said product application area in said conq^osite image 
being determined by the following formula: 

20 

Rc= [Rb * Alpha + Rp * (Alpha - UpperLimit)]/UpperLimit 
where 

Rb is a red color value of an associated pbcel in said base image 
Rp is a red color value of said selected product; 
25 Alpha is an Alpha value of an assodated pixel in said product application area; and 
UpperLimit is a predefined iq>per limit of said Alpha values 

a green color value (Gc) of said pixels of said product application area in said composite image 
being determined by the following formula: 

30 

Gc= [Gb ♦ Alpha + Gp * (Alpha - UpperLimit)]/UpperLimit 
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where 

Gb is a green color value of an associated pixd in said base image 
Gp is a grem color value of said selected product; 

Alpha is an Alpha value of an associated pixel in said product application area; and 

5 

Upperlimit is a predelGined iq}per limit of said Alpha values; and 

a blue color value (Be) of said pixels of said product application area in said conq)osite image 
being determined by the following formula: 

10 

Bc= [Bb * Alpha + Bp (Alpha - UpperLimit)]/UpperLimit 
wiiere, 

Bb is a blue color value of an associated pixel in said base image 
Bp is a blue color value of said selected product; 
IS Alpha is an Alpha value of an associated pixel in said product application area; and 
UpperUmit is a predefined upper limit of said Alpha values 

- displaying a con^osite image of said base image as modified and blended in said product 
application area and said blending region thereof 

20 

- providing means to displ^ an alternative product within said product application area 

10. A method for simulating an appearance of accessories on an image of consumer, comprising 

25 - compiling a database including an image of an accessory product and including an anchor point 
associated widi said image of each said accessory product 

- acquiring a base image of a consumer, said base image including a plurahty of pixels 
30 - defining an anchor point in said base image for location of an accessory product image 
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- calculating a base image size fitctor acoording to a pixel dimaision of a body part of said 
consumer visible in said base image 

- calculating a base image rotation fictor acoordiog to an orientation of said body part in said base 
5 image 

- receiving an accessory product selection from said consumer 

- retrieving a product image from said database assodated with said accessory product selection 

10 

- adjustiog a size of said product image according to said base image size &ctor 

- adjusting an orimtation of said product image according to said base image rotation &ctor 

IS - displagring a coixq)osite image of said base image with said product image superimposed 
thereover, said anchor point of said product image beii^ substantially aligned with said anchor 
point of said base image 

- providing means to allow said consumer to adjust the size or orientation of said product image 

20 

- adjustii^ said size or orientation of said product image and displaying an adjusted coniposite 
image in response receiving associated instructions from said consumer. 

1 1 . A method for simulating an appearance of accessories on an image of a consumer, as in claim 
25 10 further comprising: 

- assigning alpha values for certain pixels of said product image 

- blending pixels of said product image having assigned alpha values with pixels of said base image 
30 according to said alpha values 
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12. Aioethod for simulatmg an appearance of accessories onaninoage of a consumer, as in claim 
11, fiirther conoprising: 

- in said blendiiig process, said alpha values resulting in certain areas of said product im^ge being 
5 substantial^ Mfy transparoit and certain areas of said product in^ge being semi-transparent 



13. A method of marketing aesthetic products, comprisiqg: 

10 

- conpling a database of a plurality of aesthetic products^ said database including appearance 
information for each said aesthetic product 

- acquiring a base image of a consumer, said base image includoig a plurality of pixels 

15 

- identifying aproduct application area in said base image, said product application area including 
a blending region, said product application area and said blending region thereof being defined by 
sets of pixels of said base image 

20 - selecting a product selection from said database 

- retrieving appearance information associated with said selected product fi-om said database 

- modifying ^pearance information of said pixels of said product application area according to 
25 said appearance information of said selected product 

blending said product application area with said base image by modifying 
appearance information of said pixds of said blending region according to 
appearance 

30 - information of said selected product and 

according to appearance information of associated pixels of said base image in 
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said blending region 

- distributing, to said consuoier, a composite image of said base image as modified and blended in 
said product application area and said blending region thereof 

5 

14. A mefliod of marketing aesthetic products, as in daim 13 con^rising: 

- distributing a sample of said selected product with said composite image 

10 IS. A method of marketing aesthetic products, as in claim 13, fartbsc compxising: 

- assigning alpha diannei values to each pixel of said set of pixels of said product application area, 

- blending said product application area with said base iimge by modifying appearance 
15 diaracteristics of pixels of said product application area according to ^pearance information of 

said selected product and according to appearance information of associated pixels of said base 
image. 

- in said bloiding step, wei^iing said appearance information of said associated pixels of said base 
20 image and appearance information of said selected product accordipgto alpha values of associated 

pixels of said product application area 

16. A method of marketing aesthetic products, as in claimlS, further comprising: 

25 -in said blending step, weighing said appearance information of said associated pixels of said base 
image in reverse proportion to q)pearance infonnation of said selected make-up product 

17. A method of marketing aesthetic products, as in claim 16 further con;)rising: 



30 a red color value (Rc) of said pbcels of said produa application area in said conQ)osite image being 
determined by the following fonnula* 
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Rc^" [Rb * Alpha + Rp (Alpha • UpperLimtt)] AJpperLum^ \^ere 
Rb is a red color value of an assodated pixd in said base image 
Rp is a red color value of said selected product 
5 Alpha is an Alpha value of an associated pixel in said product application area; and 
UpperLimit is a predefined upper limit of said Alidia values 

a green color value (Gc) of said pixels of said product {q)pIication area in said composite image 
being determined by the following formula: 

10 

Gc^ [Gb ♦ Alpha + Gp * (Alpha - UpperLiinit)]/UpperLinnt, where 
Gb is a green color value of an associated pixel in said base image 
Gp is a green color value of said selected product; 

A^ha is an Alpha value of an assodated pixel in said product application area; and 
15 UpperLinnt is a predefined iq>per limit of said Alpha values; and 

a blue color value (Be) of said pixels of said product application area in said composite image 
being determined by the following formula* 

20 Bc= [Bb * Alpha + Bp * (Alpha - UpperLimit)]AJpperLimit, where 
Bb is a blue color value of an associated pixel in said base image 
Bp is a blue color value of said selected product; 

Alpha is an Alpha value of an associated pixel in said product application area; and 
25 UpperLinnt is a predefined upper limit of said Alpha values 

18, A method of maiketing aesthetic products* as in daim 13, \^ereia' 

said step of modifying ^pearanoe characteristics of said pixels of said product ^plication area 
30 further comprises 
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. assignii^ hue and saturation appearaoce values of said pixels of said product application area 
equal to hue and saturation qipearance values of said selected product 

- assigning intensity appearance values of said pixels of said product application areaaccording to 
5 intensity appearance values of a plurality of pixels within said product application area in said base 

image and according to intensity q)pearance vahi^ of a plurality of pixels outside said product 
q)plication area. 

19. A method of marketing aesdietic products, as in claim 18, wherein: 

10 

- said st^ of assigning intensity appearance values of said pixels of said product application area 
fimher conqxiises employing the following formula: 



Ioai = A*Ib+B 



15 



Where; 

leui is the value of the intensity of a pixel of the equalized area , 



lout can range between Upper and Lower Limits of 255 and 
0, respectively. 



20 



lin is the value of the intensity of an associated pixel of the product 
{^plication area of the base image (before equalization). 



lin can range betwreen the Upper and Lower Limits, 



25 



A is the slope of the function and is confuted according to a 
gaussian distribution function, as follows: 



A= exp(-0.5 * (Icolor-Ii«an)^/Isldcv^) 

Where, 



30 



Icoior is the value of the intensity of the applied 
product color. 
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5 



Ineaa IS mean value of the intensities of the pixels in 
the product plication area, and 
Istdsv is the variance of the intensities of the pixels in 
the product ^plication area. 



B is a constant conq)uted by equating the lb and lom values in the 
equalization function to loan snd laom > respective^. 

20. A method of marketing aesthetic products, as in daim 18, wherein: 

10 

said step of assigning intensity appearance values of said pixels of said product application area 
further conq)rises assigning intensity appearance values of said pixels of said product application 
area according to intensity {^pearance vahies of substantially all of said pixels in said base image. 

IS 21 . A me&od of marketing aesthetic products, as in claim 20, wherein: 

- said step of assigning intensity appearance values of said pixels of said product application area 
further comprises employing the following fonnula: 

20 Iout = A*Im+B 

Where; 

lout is the value of the intensity of a pixel of the equalized area , 

loot can range between Upper and Lower Limits of 255 and 
25 0, respectively. 

Tin is the value of the intensity of an associated pixel of the product 
q)pIication area of the base image (before equalization), 
lin can range between the Upper and Lower Limits, 

30 

A is the slope of the function and is computed according to a 
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gaussian distribution function, as follows: 

A = exp(-0.5 ♦ (W W^/W*) 
\ 

5 ] Where, 

Icoior is the value of the intensity of the applied 
product color, 

Imean IS mean value of the intensities of &e pixels in 
the product application area, and 
10 Istdev is the variance of the intensities of the pixels in 

the product application area, 
B is a constant conq>uted by equating the 1^ and loot values in the 
equalization function to Im and Icoior , respectively. 

15 22. A method for simulating an appearance of products on an image of a consumer as in daim 1, 
further conqnising: 

interconnecting first and second user systems through a network; 

20 receiving a product selection fi-om a first user; 

displaying a composite image incorporating said product selected by said first user on said first 
and second user systems. 
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FIG. 5 
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FIG. 6 
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FIG. 10 




10/25 



SUBSTITUTE SHEET (RULE 26) 



wo 02/05249 



PCT/IBOl/01495 
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FIG. 12 
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FIG. 13 
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FIG. 15 
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FIG. 16 
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FIG. 17 
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FIG. 18 
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FIG. 21 
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FIG. 23 




23/25 



SUBSTITUTE SHEET (RULE 26) 



wo 02/05249 



PCT/IBOl/01495 



no. 24 




24/25 



SUBSTITUTE SHEET (RULE 26) 



wo 02/05249 



PCT/IBOl/01495 



FIG. 25 
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